Appl.No. 10/807,474 
Continuation of 09/929,526 
Client Ref.: 50R4671 
Docket No.: 020699-004620US 



Date: October 16, 2007 

Appl.No. : 10/807,474 

Applicant : SAMRA, et al. 

Filed : 3/22/2004 

Title COLLABORATIVE COMPUTER-BASED PRODUCTION 



Mail Stop Appeal Brief - Patents 
Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 



In response to the Notification of non-Compliant Appeal Brief mailed 
September 21, 2007, Applicant respectfully resubmits this corrected Appeal Brief. 



TC/A.U. 
Examiner 
Docket No. 
Conf. No. 



SYSTEM INCLUDING ANNOTATION, VERSIONING AND 

REMOTE INTERACTION 

2141 

COULTER, Kenneth R. 
020699-004620US (50R4671.02) 
3062 



APPEAL BRIEF 



Page 1 of 17 



Appl.No. 10/807,474 
Continuation of 09/929,526 
Client Ref.: 50R4671 
Docket No.: 020699-004620US 

Table of Contents 



Real Party in Interest Page 3 

Related Appeals and Interference Page 4 

Status of Claims Page 5 

Status of Amendments Page 6 

Summary of Claimed Subject Matter Page 7 

Grounds of Rejection to be Reviewed on Appeal Page 8 

Argument Page 9-12 

Claims Appendix Page 13-15 

Evidence Appendix Page 16 

Related Proceedings Appendix Page 17 



Page 2 of 17 



Appl.No. 10/807,474 
Continuation of 09/929,526 
Client Ref.: 50R4671 
Docket No.: 020699-004620US 

Real Party in Interest 



The Real Party in Interest is SONY Corporation and SONY Electronics, Inc., the 
assignee of record. 
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Related Appeals and Interference 



There are no related appeals and interferences. 
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Status of Claims 



Claims 1-8 and 14-22 are pending in the present application. Claims 9-13 are 
canceled, claims 1-8 and 14-22 are on appeal. 
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Status of Amendments 



Applicants have filed an amendment with this appeal brief. The amendment is to 
claim 18. The amendment was denied entry by the examiner. 
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Summary of Claimed Subject Matter 

In claim 1 , signals from a user are accepted to select a frame in the production. 
See specification, page 7, par. 39. The annotation information and annotation marker is 
created. See specification, page 7-8, par. 33. Annotation information may be stored in 
association with selected frames in a plurality of frames of a production. See 
Specification, page 5, par. 3 1 . The annotation markers show a visual relationship of the 
annotation information's relevance to the frame. For example, the annotation marker 
may tell the user that the annotation is intended to relate to the frame underlying the 
annotation marker only or that the associated annotation may be most relevant to the 
underlying frame. Also, the annotation marker may be a dot with a forward-pointing 
arrow to indicate that the annotation is pertinent to this frame and onward through the 
plurality of frames. Other visual relationships may also be appreciated. See 
specification, page 5, par. 33. 

In claim 14, annotation information may be stored in association with selected 
frames in a plurality of frames of a production. See Specification, page 5, par. 31, page 7, 
par. 43. 

In claim 15, an annotation marker may be displayed in a frame when a frame is 
displayed during playback of the plurality of frames. See Fig. I A and specification, page 
5, par. 32 and 32. 

In claim 19, during playback, an annotation marker associated with a frame is 
determined. See Specification, page 5, par. 30-31. The frame and the annotation marker 
are displayed where the annotation marker has a visual relationship to the frame. See 
Specification, page 5, par. 31-33. Input is received and an action is performed in 
response to selecting the annotation marker. See Specification, page 6, par. 36, page 8, 
par. 45. 



Page 7 of 17 



Appl.No. 10/807,474 
Continuation of 09/929,526 
Client Ref.: 50R4671 
Docket No.: 020699-004620US 



Grounds of Rejection to be Reviewed on Appeal 



1. Whether claim 18 is unpatentable under 35 U.S.C. §1 12. 



2. Whether claims 1-8 and 14-22 are unpatentable over Matsuzawa et al (U.S. 
Patent No. 6,085,185, hereinafter "Matsuzawa") under 35 U.S.C. §102(e). 
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Argument 

Section 112 Rejections 
Claim 18 

In an amendment after final, Applicants have amended claim 18 to read 
"an action". Applicants submit that claim 18, as amended, now complies with the 
requirements of Section 112. The amendment was denied entry by the Examiner. 
Applicants request entry of the amendment if all other issues are resolved by the appeal. 

Section 102 Rejections 

Claims 1 and 19 

Claim 1 was rejected under 35 U.S.C. §102 as being anticipated by 
Matsuzawa. Applicants submit that Matsuzawa fails to disclose or suggest that an 
annotation marker is displayed with the frame when the frame is displayed during 
playback of the plurality of frames in the production, the annotation marker showing a 
visual relationship of the annotation information's relevance to the frame. 

The final rejection stated that Matsuzawa discloses that a user puts an 
annotation to a specific range of a medium and the system registers an annotation object 
comprising the object ID of the target medium, specific range, and annotation 
information in a table. Figs. 4-5 in Matsuzawa as referenced in the final rejection show a 
table that is storing the annotation information. This table may be stored and may be 
later viewed. However, applicants submit this does not disclose or suggest that the 
annotation markers are displayed with the frame when the frame is displayed during 
playback of the plurality of frames in the production . Matsuzawa is directed towards the 
retrieval of recording material without requiring manual steps. See Matsuzawa, col. 2, 
lines 22-27. What is shown in Figs. 4-5 is a table that is created to summarize the 
annotation information. This table is not the production of frames nor is it displayed 
during playback of the plurality of frames. 
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The table may include a range of values for frames. However, this table is 
not shown during playback of the plurality of frames. Rather, Matsuzawa might retrieve 
the range of frames and play them back. As shown in Fig. 4, the table shows a range in 
columns 703 and 704. However, this table is not used when playback of a production is 
performed. 

Also, Fig. 5 shows a thumbnail in the table. However, this thumbnail is 
extracted from the video. See Matsuzawa, Fig. 17. Thus, the annotation information is 
not displayed during playback of the production. 

Also, Matsuzawa does not disclose or suggest the annotation marker 
shows a visual relationship of the annotation information's relevance to the frame. Fig. 5 
and 17 are cited in the final office action as disclosing this element. Fig. 5 in Matsuzawa 
shows a table and fig. 17 shows an extraction process. There is no visual information that 
shows the relevance to the frame in Figs. 5 and 17. Fig. 5 shows an annotation 
management table. The table does not include annotation information that would show a 
visual relationship when displayed with the frame during playback of the frame. In fact, 
the annotation information shown in the table is not displayed with the thumbnail during 
playback. Even if the table is considered playback of the thumbnail (it is not), the 
information does not show a visual relationship of the annotation information's relevance 
to the frame. As described in the specification in paragraphs 31-34, the annotation 
marker tells a user how the annotation information is intended to relate to the frame 
underlying the annotation marker displayed. For example, in embodiments of the present 
invention, the annotation marker may indicate that the annotation information is only 
relevant to the underlying frame. Also, the annotation marker may indicate that the 
annotation information may be relevant to the underlying frame and also additional 
frames, such as frames subsequent to the underlying frame. In one embodiment, the 
visual information may be a dot with a forward-pointing arrow to indicate that the 
annotation is pertinent to this frame and onward through the plurality of frames. Other 
visual relationships may also be appreciated. Accordingly, Matsuzawa does not disclose 
or suggest a visual relationship as claimed. 
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Applicants submit that claim 19 should be allowable for at least a similar 
rationale as discussed with respect to claim 1. 

Claim 14 

Matsuzawa does not disclose or suggest that the annotation marker is 
stored as part of the frame in the production. The final rejection states that Figs. 1-6 and 
col. 4, lines 30-31 disclose this element. Figs. 1-6 show tables that may be stored in 
media. However, applicants submit that this does not disclose or suggest that the 
annotation marker is stored as part of the frame in the production . Rather, these tables 
are separate from the frames of the production. Also, these tables are used to retrieve 
parts of the production and are not part of the production. See Matsuzawa, col. 2, lines 
22-27 '. Thus the annotation information is not stored as part of the frame in the 
production. Also, in Fig. 5, a thumbnail may be stored in the table. However, this is not 
storing an annotation marker as part of the frame in the production. As claimed, the 
annotation information is part of the information that makes up the frame. 

Claim 15 

Matsuzawa does not disclose or suggest that the annotation marker is 
displayed in the frame being displayed. The rejection states that Figs. 2-6 and 17 disclose 
this element. Figs. 2-6 of Matsuzawa show tables that include annotation information. 
Fig. 17 is a flow chart for extracting thumbnails. Nowhere in these figures is it disclosed 
or suggested that the annotation marker is displayed in the frame being displayed. As 
shown in Fig. 5, the thumbnail is shown in a column 706. None of the annotation 
information in the table is displayed in the thumbnail. If the thumbnail was a picture, 
then the annotation information would be displayed in the picture. Matsuzawa does not 
disclose or suggest this. 
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Claims 2-8 and 14-18 and 20-22 



Applicants submit that claims 2-8 and 14-18 and 20-22 depend from 
claims 1 and 19 and thus derive patentability at least therefrom. 



Respectfully submitted, 



TRELLIS INTELLECTUAL 
PROPERTY LAW GROUP, PC 



By /Brian N. Young/ 

Brian N. Young 
Reg. No. 48,602 
Tel.: 650-842-0300 
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Claims Appendix 

Listing of Claims: 

1 . (Previously presented) A method for annotating an item in a user 
interface of a media production system, the method comprising 

accepting signals from a user input device to select a frame in a plurality 
of frames of a production being processed by the media production system; 

creating annotation information and an annotation marker; and 
storing the annotation information in association with the selected frame 
of the production, wherein the annotation marker is displayed with the frame when the 
frame is displayed during playback of the plurality of frames in the production, the 
annotation marker showing a visual relationship of the annotation information's 
relevance to the frame. 

2. (original) The method of Claim 1, further comprising 
accepting signals form a user input device to create the annotation 

information. 

3. (Previously presented) The method of Claim 2, wherein the annotation 
information includes text information. 

4. (Previously presented) The method of Claim 2, wherein the annotation 
information includes capture of drawing information. 

5. (Previously presented) The method of Claim 2, wherein the annotation 
information includes audio information. 
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6. (original) The method of Claim 1, wherein the annotation information 
is automatically generated by a process executing on a digital system. 

7. (original) The method of Claim 6, further comprising 
wherein the annotation information is automatically generated at a 

predetermined time. 

8. (original) The method of Claim 6, further comprising 

wherein the annotation information is automatically generated upon the 
occurrence a predetermined event. 

9-13. (Canceled) 

14. (Previously presented) The method of claim 1 , wherein the 
annotation marker is stored as part of the frame in the production. 

15. (Previously presented) The method of claim 1, wherein the 
annotation marker is displayed in the frame being displayed. 

16. (Previously presented) The method of claim 1 , wherein the 
annotation marker indicates one or more additional frames that are relevant to the 
annotation information. 

17. (Previously presented) The method of claim 1, wherein the 
annotation marker is associated with an action that is performed when the annotation 
marker is selected. 

18. (Previously presented) The method of claim 1, wherein the action 
comprises displaying the annotation information. 
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19. (Previously presented) A method for displaying a production in a 
user interface of a media production system, the method comprising 

during playback of the production, wherein the production includes a 
plurality of frames, determining when an annotation marker is associated with a frame in 
the plurality of frames; 

displaying the frame and the annotation marker, wherein the annotation 
marker shows a visual relationship of annotation information's relevance to the frame; 

receiving an input selecting the annotation marker; and 

performing an action with the annotation information in response to the 
selecting of the annotation marker. 

20. (Previously presented) The method of claim 19, wherein the 
action comprises displaying the annotation information. 

2 1 . (Previously presented) The method of claim 1 9, wherein the 
annotation marker indicates one or more additional frames that arc relevant to the 
annotation marker. 

22. (Previously presented) The method of claim 19, wherein the 
annotation marker is displayed in the frame being displayed. 
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Evidence Appendix 



NONE 
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Related Proceedings Appendix 



NONE 
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